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(57) Abstract: The present invention concerns an apparatus (1) for staining tissue samples, said apparatus (1) including a reagent 
section (2) or reagent containers (3); at least one staining section or tissue samples, a robotic head (22) or robotic element (20) that 
may move reagent to a predetermined tissue sample, said robotic element (20) being moveable above the reagent and the staining 
sections, a control element (85) that may manage a staining process, a 2-D optical sensor (86) to detect two-dimensional image data 
of a relevant property and that can feed the captured image data to the control element (86). By providing the robotic element (20) 
with a 2-D optical sensor (86), a common image processor may be provided having multiple functions. By using a 2-D optical image 
processing system, the control system of the apparatus may easily be adapted to read various types of data presentations, just as 
actual images for sections of the apparatus may be identified in order to assess the condition of the apparatus. The optical sensor 
may be used to automatically identify the slides and the reagent containers present in the apparatus, just as the optical sensor may be 
used for checking if a slide is misplaced at or absent from a slide position, etc. 
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A METHOD AND APPARATUS FOR AUTOMATIC STAINING OF TISSUE 
SAMPLES 

TECHNICAL FIELD 

5 

The present invention relates to an apparatus and a method for automatic staining of 
tissue samples. It may further relate to systems for sample processing and data 
acquisition, data maintenance, and data retrieval for sample processing. Applications 
to which the present invention may especially relate include immunohistochemistry, 
10 in-situ hybridization, fluorescent in-situ hybridization, special staining, and cytology, 
as well as potentially other chemical and biological applications. 

BACKGROUND 

15 Tissue sample processing in immunohistochemical (IHC) applications and in other 
chemical and biological analyses, such as in-situ hybridization, special staining and 
cytology, may require one or more processing sequences or protocols as part of an 
analysis of one or more samples. The sample processing sequences or protocols may 
be defined by the individual or organization requesting an analysis, such as a 

20 pathologist or histologist of a hospital, or may be defined by dictates of a particular 
analysis to be performed, e.g. standardized protocols defined by an organization. 

In preparation for sample analysis, a biological sample may be acquired by known 
sample acquisition techniques and may comprise tissues which in some applications 
25 may even be one or more isolated cells. The tissue sample may be accommodated on 
a sample carrier such as a slide or perhaps a microscope slide. 

For example, immunologic applications may require processing sequences or 
protocols that comprise steps such as deparaffinisation, target retrieval, and staining. 
30 Previously, in some applications, these steps may have been performed manually, 
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potentially resulting in a time consuming protocol and necessitating personnel to be 
actively involved in sample processing. In particular relating to the staining process, 
various devices for automated staining of tissue slides are known, as attempts have 
been made to automate sample processing to address the need for expedient sample 
5 processing and less manually burdensome operation. 

Aspects of the present invention may be especially applicable to sample processing 
having one or a plurality of processing steps to be performed on one, a portion, or an 
entirety of samples, such protocols identified in some instances by the individual 
10 carriers presenting the samples. Aspects of the present invention may be especially 
applicable to immunohistochemistry (IHQ techniques, as well as in-situ 
hybridization (ISH) and fluorescent in-situ hybridization (FISH), especially 
techniques incorporating the staining of samples. 

15 Embodiments of the invention may further relate to automated control systems for 
sample processing. Embodiments may also be directed to data acquisition, data 
maintenance, data retrieval for sample processing, especially information sharing of 
processing protocol and processing status, such as for individual samples or multiple 
batch processing, sample diagnostic features, and real-time or adaptive capabilities 

20 for multiple batch processing. 

US 5,839,091 discloses an apparatus for automatic tissue staining where microscope 
slides are arranged in a number of rows and reagent vials are stored in a section next 
to this slide section. A robotic head picks up a predetermined amount of reagent from 

25 a bottle and deposits this amount of reagent on a predetermined slide and blows the 
liquid off the slides according to a control program. This program is run on a 
computer that is coupled to the staining apparatus. The apparatus is loaded with a 
number of slides, and each slide and its position is registered in the computer and a 
staining sequence is selected. The program also receives data relating to the reagents 

30 and their position in the reagent section. On the basis of these slide and reagent 
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position data, the program calculates a staining run and controls the robotic motion in 
the apparatus. 

US 6,352,861 discloses a carousel-type automatic staining apparatus in which the 
5 slides are arranged on a rotatable carousel slide support and the reagents are similarly 
arranged on a rotatably carousel reagent support above the slide support. A particular 
slide is then rotated to a delivery zone and a particular reagent vial is also rotated to 
this position and reagent is dispensed onto the slide. The slides and the reagent 
bottles are provided with bar codes and associated bar code readers are provided to 
10 identify the slides and the reagents respectively. A blowing zone and an identifying 
zone are also provided at the periphery of the slide carousel. The slide bar codes 
identify the slide samples and their particular immunohistochemical processes 
required for the particular samples. A reagent bar code reader is positioned to scan 
the reagent bar codes on the reagent bottles. The scanned information from the slide 
15 bar code reader and the reagent bar code reader is fed into a computer and correlated 
with the indexed position of the slide and the reagent carousel, respectively. This 
information is used to rotate the slide carousel and the reagent carousel to place the 
correct reagent bottle in the dispense zone for each slide treatment step for each slide. 

20 A drawback of the automated staining apparatus described in '091 is that the position 
of each of the tissue slides and each of the reagent vials in the slide section and in the 
reagent section, respectively, must be entered manually into the computer, since the 
control program cannot check the location of the particular slides and reagent vials. 
This involves the risk that a misplaced slide is treated with the wrong staining 

25 protocol and makes the apparatus very inflexible in use. 

Although the '861 patent uses a bar code identification of the slides and reagents, this 
carousel-type apparatus is time consuming in running the staining protocols, since 
this involves rotating the carousels with the entire reagent inventory and the slide 
30 carousel with all the slides for each step in a protocol. These rotations are time 
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consuming and make this type of apparatus unsuitable for running of larger numbers 
of slides. Moreover, the bar codes can only carry a small amount of data, typically 
simply an identification code, which means that the control computer must be , 
provided with corresponding data associated with the identification codes. 

5 

DISCLOSURE OF INVENTION 

It is an object for the present invention to provide an automatic tissue sample 
10 processing apparatus of the initially mentioned kind, with automatic identification of 
the inventory of reagents and slides present in the machine. Another object is to 
provide identification of relevant properties of the apparatus to allow for automatic 
preparatory checks before a staining process of newly loaded slides is initiated. 

15 In one embodiment these objects are achieved by an apparatus of the initially 
mentioned kind wherein a robotic element, perhaps with a robotic head, is provided 
with an optical sensor, or perhaps a 2-D optical sensor means for detecting two- 
dimensional image data of a relevant property and with the capability of feeding the 
captured image data to the control means. 

20 

The invention also provides a method of identifying at least one property in an 
automatic staining apparatus perhaps including at least one slide array and a reagent 
array and a robotic element or perhaps robotic means for performing staining of the 
slides also using reagents; 
25 said method including in one embodiment the steps of 

providing optical sensor means on the robotic head of the robotic means, 
moving the optical sensor means on said robotic head to a predetermined 
position, 

recording relevant image data at said position, and 
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feeding said image data to a control system for manipulating the staining process 
according to said image data. 

Furthermore, the invention concerns a method of staining tissue samples in an 
5 automatic staining apparatus perhaps including at least one slide array and a reagent 
array, a robotic element or perhaps and robotic means for performing staining of the 
slides also using reagents according to tissue sample specific staining protocols; said 
method including in one embodiment the steps of: 

providing optical sensor means on the robotic head of the robotic means, 
10 moving the optical sensor means on said robotic head to a predetermined 

position, 

recording relevant image data at said position by said optical sensor 
means; 

feeding said image data to a control system for manipulating the staining. 
15 process according to said image data; and 

staining a tissue sample also using reagent from a reagent container. 

In embodiments, the automatic staining apparatus 1, that is any apparatus that stains 
with at least some automated operation, may include a reagent container 3. One or 

20 more reagent containers 3 may be positioned in a reagent section 2 of the automatic 
staining apparatus 1. The automatic staining apparatus may also include a tissue 
sample 74 which may therein be placed on a slide. A plurality of slides with tissue 
samples thereon may also be positioned in a slide section 5 of the automatic staining 
apparatus 1. The invention, in embodiments, may also include a robotic element 20, 

25 some type of control element, and even an optical sensor (86), perhaps an image- 
capture 2-D optical sensor. As can be easily understood, the control element 85, may 
be a computer, software routine, or merely a particular programmable processor 
functionality. 
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As mentioned, the present invention may provide for the capability of optically 
sensing a two dimensional image. This can occur through an image-capture 2-D 
sensor which may provide a two-dimensional image of an element in the auto 
staining apparatus 1. Through providing the robotic element or perhaps a robotic 

5 head with a 2-D optical sensor or means, as but one embodiment, a common image 
processing means is able to have multiple functions. By using a 2-D optical image 
processing system, the control system of the apparatus may easily be adapted to read 
various types of data presentations, just as actual images of elements or for sections 
of the apparatus may be identified in order to assess the condition of the apparatus. 

10 The optical sensor or optical sensor means may be used to automatically identify the 
slides and the reagent containers present in the apparatus, just as the optical sensor or 
optical sensor means may be used for checking if a slide is misplaced at or absent 
from a certain slide position, etc. 

15 An optical sensor provides a staining apparatus according to the invention with a 
hitherto unseen flexibility and possibility of automating the identification functions 
in a staining apparatus. By utilizing a CCD-camera or the like, perhaps on the robotic 
head or even the robotic element, individual identification means for each of the 
identification tasks may no longer be required. This means that controlling as well as 

20 maintenance of the apparatus is facilitated. The software controlling the apparatus 
may be adapted to include automated identifications of various properties and 
conditions of the apparatus, including slide and reagent information. By a method of 
identifying relevant properties in the staining apparatus and a method of performing 
the staining process according to the invention, the automated staining process may 

25 be less time-consuming and more qualitative checks may be included without loosing 
any significant speed in the slide staining operations. 

In one embodiment of the invention, the reagent section accommodates a plurality of 
reagent containers stationary arranged in a plurality of rows. Similarly, the tissue 
30 samples are accommodated on slides that are stationary arranged in a plurality of 
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rows in the at least one staining section or slide section during the staining process. 
The layout of these sections is such that it presents a substantially planar platform 
work area for the robotic head, which is moveable in the X and Y-axis. In a 
particularly preferred embodiment, a row of slides and/or reagents can be removed 
5 and be replaced without interfering with the staining process. 

In another preferred embodiment, the apparatus comprises at least two staining 
sections separated by a reagent section, that is they may be arranged so that at least 
some of the tissue samples are closer to at least some of the reagent containers. 

10 Hereby, the movements required by the robotic head in order to reach all the slides 
may be significantly limited and the capacity of the staining apparatus can hereby be 
increased, just as a reduction in the time for running the staining protocols or other 
advantages may be achieved. It is further realized that these shorter processing times 
or other advantages may also be achieved by this layout of the slide and reagent 

1 5 sections without a vision system, e.g. an optical sensor. 

In other preferred embodiments of the invention, the optical sensor may be a camera 
or perhaps include a CCD element. By the term "camera" it should be understood 
that any image capture apparatus is intended whether or not is uses film, plates, 

20 memory, or any type of electronic media and whether or not it images light, visible 
electromagnetic radiation, or even non-visible electromagnetic radiation such as now 
well known. By recording the relevant image, relevant image data, or even recording 
digital image data, a computer processing of this data in the control system may be 
carried out in a quick manner by known image processing capabilities already 

25 available. Moreover, by using this digital technology relative complex images can be 
recorded with high resolution, just as a fast recording of several identifications, e.g. 
labels on an entire row of slides, may be achieved as the robotic head may be moved 
across the slide labels in a continuous movement, so stop and start time for each slide 
identification may be avoided. However, by the invention it is realized that other 
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image sensors, e.g. solid state sensors, or perhaps CMOS sensors could also be used 
depending on the requirements for image resolution. 

As indicated above, the optical sensor may be adapted to record the individual 
5 reagent containers or bottles and slides present in the apparatus. While of course it 
may image larger areas, or perhaps even the entire device, it may be configured for 
individual imaging either electronically, optically, or positionally. Regardless, as a 
result of the imaging capability, predetermined positions of the slides or reagent 
containers or bottles that are loaded into the automatic staining apparatus may not be 
10 required, since the apparatus may be adapted to automatically identify new slides and 
reagent bottles once they are loaded into the apparatus. 

In an embodiment, the reagent containers and the slides may be provided with an 
optical identification element. For example, a reagent container may be provided 

15 with a reagent optical identification element and a slide may be provided with a slide 
optical identification element. These optical identification elements may contain 
machine readable data concerning the reagent type as well as other relevant data 
relating to the reagent in the bottle, and the slide identifiers may contain data 
concerning the tissue sample, such as identification of the patient, the staining 

20 protocol, etc. An optical identification element may include reiterated information or 
perhaps even redundant information. This may include information that is repeated 
or even partially repeated and may even include information that may or may not be 
in different versions which may relate to similar information. 

25 The optical identification element or alternatively optical identification means may 
be on or even mounted on the reagent container or on the slides in such a manner that 
the optical identification element is readable by the optical sensor. By being 
positioned "on" it is intended that any manner of association be encompassed; thus it 
should be understood that separate attachment or surface mounting is not required. 

30 Similarly, by being "above" it should be understood that this may exist not only in a 
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sense such as with respect to gravity, but also in a figurative sense such as roughly 
perpendicularly above a surface or the like. In an embodiment, the optical 
identification element may be readable from above by the optical sensor or 
alternatively means. Furthermore, the optical identification element may be provided 

5 on a label, which is perhaps adhesively attachable to a specific slide or reagent bottle. 
Hereby, the labels or perhaps adhesive labels may be presented to the optical sensor 
means on the robotic head above the slides and the reagent bottles facilitating the 
reading of the optical identification means. By providing the optical identification 
means on a printed label which is attached to the slide, respectively the reagent 

10 bottle, individual labels may be prepared on site and the relevant data may be entered 
into a computer and a corresponding label carrying said relevant data may be printed 
on an associated label printer. 

In an embodiment of the invention, one type of optical identification element may be 
15 a two-dimensional high-resolution symbology code, e.g. of the so-called 
"Infoglyph™" type. The optical identification may also be more generically a two- 
dimensional symbology. Two-dimensional symbology may be representative of data 
including, but not limited to: tissue sample related data, patient identification data, 
staining protocol data, reagent related data, reagent type data, reagent volume related 
20 . data, reagent durability related data, and the like data. By encoding the relevant 
information into numerous tiny, individual graphic elements, typically small lines in 
45° diagonal lines as short as 0.02 mm (1/100 inch), a high resolution with high 
contrast encoded information label may be achieved which is printable in a printer 
and readable by a high resolution camera. The type of encoded 2-D symbology label 
25 may be provided in different colors and in a variety of materials. 

Alternatively, the optical identification means or alternatively the optical 
identification element may be a data matrix code or even a one-dimensional bar 
code, namely the identification code with a pattern of Vertical bars whose width and 
30 spacing identifies an item marked. An advantage of using an optical sensor capable 
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of reading 2-D symbology is that the apparatus may be capable of reading any kind 
of optical identifier, as this is only requires an adaptation in the software processing 
the captured perhaps digital image. 

5 In an embodiment, an optical identification element label may include a two- 
dimensional (2-D) symbology zone and even at least one human readable text zone, 
each as conceptually depicted in Fig. 5. Hereby, an extra visual inspection of the 
label by the operator may be provided for verification of the printed label. 

10 In a more advanced usage of the 2-D image capturing capability, the image 
processing capability or image processor element may be adapted to identify the 
texture or outline of the tissue sample itself captured by the optical sensor and may 
use said image-captured tissue property as an individual identification of the tissue 
sample. The optical sensor may be configured to identify desired features of the 

15 tissue samples such as but not limited to the texture, outline, a visual property, or 
even an individual feature of a tissue sample. Of course, various different features or 
properties may be identified as desirable to detect or perhaps identify, a property 
which may include any attribute, characteristic, or the like. This embodiment could 
make the use of slide labels obsolete, as the tissue texture itself or at least a 

20 predefined section thereof (with or without magnification) could be used as an 
identifier for a list of data in the control software. 

In one preferred embodiment of the invention, the optical sensor may be a moveable 1 
optical sensor which may be moveable along the areas above the staining and the 

25 reagent sections, and said optical sensor may be adapted to determine the presence of 
and the positions of slides in the at least one staining section. This may be facilitated 
by having the optical sensor movable in response to or perhaps on a robotic element. 
Once a new set of slides are being loaded into the apparatus, this feature would allow 
the staining apparatus according to this embodiment of the, invention to automatically 

30 determine where the slides are positioned so that the optimal scheduling of treatment 
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steps can be calculated. The optical sensor may even determine the approximate 
location and the approximate area of a tissue sample. Furthermore, this capability 
may also provide the apparatus control software with warning if a slide is not 
correctly positioned or other irregularities have occurred during the loading of the 
5 slides. 

In another embodiment of the invention, the optical sensor may be adapted to locate 
pre-selected reference locations for self-calibration of the robotic control system or 
robotic element controlling the movements of the robotic head. The camera can be 

10 used to teach the robotic arm critical locations necessary to calibrate the system, 
allowing the apparatus to properly position the robotic head to all required positions 
and locations within the platform work area. If the apparatus has been moved or 
otherwise been tampered with, e.g: due to maintenance, etc., this feature may provide 
the staining apparatus according to the invention with the capability of self- 

15 calibrating the robotic motion control system, e.g. if the slides are arranged in racks 
(intended to broadly encompass any locationally tied collection) by checking if the 
slide rack fit correctly into a receiving element in the apparatus, and/or by 
determining the position of predefined reference components of the apparatus. 

20 In another embodiment of the invention, the optical sensor may be a camera adapted 
to record an image of the finalized tissue sample after said tissue sample has been 
subjected to a staining protocol for recording an image of the manipulated tissue 
sample. Hereby, a picture or digital image of the stained tissue sample may be 
recorded, preferably in a high resolution, for later examination or for sending this 

25 digitalize picture to a remote location for examination. Accordingly, in embodiments 
the present invention may provide for storing an image relevant to the process of 
staining tissue samples. This may include images both before and after staining or 
some, other operation, of course. Also, this feature of the invention may provide for 
archiving images of the about to be stained or the stained tissue samples for later 

30 verification of the tissue sample analysis or the identification if this should it be 
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required. Thus the invention may automatically facilitate a user activity such as 
those mentioned. To understand the various possibilities, the automatic facilitation 
may be of activities including, but not limited to, later accessing a historical image of 
a stained tissue sample, remotely accessing an image of a stained tissue sample, 
5 archiving an image of a stained tissue sample, later accessing a historical image of an 
unstained tissue sample, remotely accessing an image of an unstained tissue sample, 
archiving an image of an unstained tissue sample, and the like activities. 

A sensor may be provided in some embodiments that may automatically identify 
10 information from one or more slides or reagent containers. In some embodiments, 
protocol information may be provided by the adaptive sample processing control 
system. The sample processing system may process one or more slides, or one or 
more batches of slides, concurrently, sequentially, or in any other temporal fashion, 
potentially in accordance with protocol information provided by a slide having a 
15 sample or provided by the adaptive sample processing control system. Sample 
batches or individual slides may be inserted or removed during processing protocol 
steps by the control and monitoring accomplished by the adaptive sample processing 
control system. 

20 Another embodiment of the present invention that may achieve the foregoing and 
other objects of invention may comprise a method of sample processing, comprising 
the steps of: accessing at least one of a plurality of drawers, providing at least one 
sample carrier retainment assembly configured with at least one sample carrier, 
configuring at least one of the drawers with the at least one sample carrier retainment 

25 assemblies, and adaptively processing the sample carriers. The step of adaptive 
processing may automate the processing of samples and may allow for either or both 
continuous or batch processing of slides, and may afford multiple independent slide 
processing and in some embodiments redundant slide processing to process each 
slide independently. 

30 
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Embodiments of the invention may further comprise a method of automated sample 
processing, comprising the steps of: acquiring protocol information, transmitting the 
protocol information to at least one sample processing system, adaptively processing 
samples, and acquiring sample processing information from the step of adaptively 

5 processing. Furthermore, embodiments may provide: maintaining the protocol 
information, maintaining the sample processing information, information sharing of 
protocol information, and sample processing information. These and other method 
steps may be provided for individual samples or multiple batch processing, sample 
diagnostic features, and real-time or adaptive capabilities for multiple batch 

10 processing. 

Many aspects of invention are applicable to immunohistochemistry (IHC) 
techniques, as well as in-situ hybridization (ISH) and fluorescent in-situ 
hybridization (FISH) special staining of samples, and microarrays, especially 
15 techniques incorporating target retrieval or the staining of samples. 

Support should be undersood to exist for the following aspects and embodiments of 
the invention: 

An automatic staining apparatus comprising: 
20 at least one reagent container; 

at least one sample; 

a robotic element adapted to affect said reagent container and said 
sample; 

a control element to which said robotic element is responsive; and 
25 an image-capture 2-D optical sensor configured to two dimensionally 

image at least one element in said automatic staining apparatus. 

A method of identifying at least one property in an automatic staining apparatus 
comprising the steps of: 
30 providing at least one sample; 
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providing at least one reagent container; 

providing a robotic element adapted to affect said reagent container 
and said sample; 

optically sensing a two dimensional image of at least one element in 
5 said automatic staining apparatus; 

recording relevant image data; and 

feeding said image data to a control element to which said robotic 
element is responsive. 

10 A method of staining samples in an automatic staining apparatus comprising 

the steps of: 

providing at least one sample; 
providing at least one reagent container; 

providing a robotic element adapted to affect said reagent container 
15 and said sample; 

providing an optical sensor responsive to said robotic element and 

adapted to sense a two dimensional image of at least one element in 

said automatic staining apparatus; 

recording relevant image data; and 
20 feeding said image data to a control element to which said robotic 

element is responsive. 

An automatic staining apparatus comprising: 
at least one reagent container; 
25 at least one sample; 

a robotic element adapted to affect said reagent container and said 
sample; 

a control element to which said robotic element is responsive; and 
a multifunction optical sensor configured to sense at least one element 
30 ' in said automatic staining apparatus. 
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BRIEF DESCRIPTION OF DRAWINGS 

In the following the invention is described with reference to the accompanying 
5 drawings, in which: 

Fig. 1 is a schematic perspective view of a staining apparatus according to the 

preferred embodiment of the invention; 
Fig. 2 is a top view of the work area in the staining apparatus shown in fig. 1 ; 
10 Fig. 3 is a detailed view of the robotic element in the staining apparatus 
according to some embodiments of the invention; 
Fig. 4 is a top view of a reagent bottle with optical identification means; 
Fig. 5 is a microscope slide with an optical identifier label thereon; 
Fig. 6 is an example of a lay-out of this label; and 
15 Figs. 7 to 10 are examples of various kinds of optical identifying means on the slides. 

MODE(S) FOR CARRYING OUT THE INVENTION 

An automatic staining apparatus 1 according to the invention is shown in figures 1 
20 and 2. The automatic staining apparatus 1 comprises a rectangular frame 4 
surrounding a reagent station or section 2 comprising an array of reagent bottle or 
container compartments, wherein each compartment a reagent vial or reagent 
container 3 is placed, and a first and second slide sections 5 wherein a number of 
separate racks 6 is placed, and where each rack 6 comprises a number of microscope 
25 slides 7 mounted side by side in the rack 6. A plurality of reagent containers or even 
slides may be placed in any desired order, an array. In the embodiment shown, each 
rack may hold up to 8 slides, but the rack may be designed to hold any suitable 
number of slides. With eight racks arranged side by side, the shown embodiments 
may hold up to 64 slides 7 each having a sample, e.g. a tissue mounted on the upper 
30 side of the slide, so that reagent may be applied from above to the sample on each 
slide. The sample processed may be any material, but is most likely a biologic 
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material such as a biological sample or a biological specimen, perhaps such as a 
histological sample, e.g. tissue and cell specimens, cells, collections of cells, or tissue 
samples, the definition to include cell lines, proteins and synthetic peptides, tissues, 
cell preps, cell preparations, blood, bodily fluids, bone marrow, cytology specimens, 
5 blood smears, thin-layer preparations, and micro arrays. It should also be understood 
to include slide-based biological samples. 

As mentioned, the present invention may include a robotic element, which may 
somehow affect the reagent container and tissue sample. Thus any sort of action to, 

10 action resulting from, or merely information from the reagent container or tissue 
sample may be facilitated through the robotic element. The robotic element, in 
embodiments, may be adapted to perform staining of the slides with (including as a 
result of or in conjunction with) the reagent application or the like. The robot arm or 
robotic element 20 may also remove reagent from a reagent container to a 

15 predetermined tissue sample. For example, a robotic element 20 for moving a probe 
10 in X and Y (as well as Z) direction as indicated by the arrows X and Y is arranged 
above the frame 4 of the staining apparatus. A robot arm may position the probe 10 
above all reagent vials 3 as well as above all the slides 7, and may further operate the 
probe 10 to aspirate portions of reagent contained in any of the vials 3, to transfer the 

20 portion of reagent and apply it to any of the slides 7 in order to provide a selected 
staining or treatment of the sample on each slide 7. A control element may manage a 
staining process by controlling the entire process or even any portion of it. By use of 
a suitable control element or alternatively a control means e.g. capability within a 

v computer (not shown) having the appropriate software and input data for the purpose, 

25 this staining apparatus 1 may be able to automatically stain or treat samples requiring 
different staining or treatment reagents and processes. 

As shown in fig. 1 and 3, the probe 10 is accommodated in a robotic head 22 and is 
manipulated by the robotic element 20. The probe 10 is raised to an upper position 
30 (in. a Z direction), where it is clear of the vials 3 underneath the probe 10, but the 
robot may include means or element in the robotic head 22 for lowering the probe 10 
in order to dip the probe tip into the content of a selected reagent vial 3 and to 
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aspirate a selected amount of reagent for the selected staining or treatment process. 
In an embodiment, the present invention may include providing an optical sensor 86 
on a robotic element and perhaps moving the optical sensor to a predetermined 
position through action of the robotic element. As but one example, the robotic 
5 head 22 may be provided with an optical sensor 86, perhaps even a CCD camera 25 
pointing downwards. An optical sensor may be positioned on or perhaps more 
broadly in response to the robotic element. After the optical sensor is positioned, 
image data may be recorded at the location at which the optical sensor is established. 

10 In some embodiments a robotic element 20 or even a robotic head 22 may include a 
variety of components, including but not limited to a push tool 38 that may be 
connected to an air cylinder 39, a probe 10 that may be responsive to a probe 
movement element 36 which may even be connected to a syringe pump 37, and an 
optical sensor 86 as shown in Figure 3. 

15 

In embodiments, the optical sensor may detect two-dimensional image data of a 
relevant property. It may also be adapted to sense a two-dimensional image of an 
element in general. The camera may be utilized to determine status information of 
the slides and the reagent bottles and other features of the apparatus in the work area, 

20 for example reading a code provided on a reagent container to determine the reagent 
type and the reagent location within the system. The camera may also determine 
status of the tissue sample carriers, for example the location of a particular slide, 
informational indicia, such as a code, that indicate information about the tissue 
sample presented on the slide or the processing protocol to be performed. A camera 

25 may be used for diagnostic purposes. In some embodiments, the sample may be 
scanned for further analysis, potentially by a computer. The present invention may 
include, in embodiments, a computer image biological analysis element or perhaps 
even biologically analysing image data of a sample with a computer. 

30 As previously discussed, the invention may include recording a variety of relevant 
image data. Of course, a variety of relevant image data may be recorded. 
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Importantly, this may include recording element calibration reference points, or 
perhaps even robotic element calibration reference positions on or in the apparatus. 
As mentioned* the invention may also provide for recording slide identification 
image data and reagent identification image data; A significant aspect of an 
5 embodiment is the possibility of recording an optical identification element of a 
particular slide or perhaps merely recording information relevant to an element. 
Such information may include information concerning the tissue sample, of course. 
Similarly, optical identification may be recorded on a reagent container that may 
include information concerning the reagent contained therein. It may provide for 

10 recording a two-dimensional symbology on a slide or even on a reagent container. 
Two-dimensional symbology recorded on a slide may represent data including, but 
not limited to: tissue sample related data, patient identification data, staining protocol 
data, or the like. Two-dimensional symbology recorded on a reagent container may 
represent data including, but not limited to: reagent related data, reagent type data, 

15 reagent volume related data, reagent durability related data, or the like. It may also 
provide a connection element through which captured image data may be transferred 
to the control element. It may include feeding the image data to a control element so 
that the robotic element may respond. After the relevant image data has been 
recorded, and perhaps as a result of feeding that data to the control element, the 

20 invention may manipulate a staining or other process according to that relevant 
image data. Thus the invention may perform staining of slides according to tissue 
specific protocols. 

The staining apparatus 1 of the present embodiment further comprises a probe 
25 washing station 8 and a reagent mixer 9, and the robotic element 20 is furthermore 
arranged to transfer the probe to the washing station 8 as well as to the reagent mixer 
9. 

As shown in fig. 4, the reagent bottle 3 may be provided with an area 30 on a surface 
30 on which to mount an optical identification element. This optical identifier may be an 
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adhesive label 31 carrying encoded information about the content of the bottle 3, 
such as reagent type, date of manufacture, expiry date, etc. The encoded information 
could be in the form of a data matrix code, an Infoglyph code or any other kind of 2- 
D code, and could in principle also be a simple 1-D code, i.e. a bar code. 
5 Additionally, the label 31 may also be provided with human readable text to aid the 
operator handling the reagent bottles e.g. during loading of bottles into the staining 
apparatus. 

Fig. 5 shows a slide 7 with a label 71 mounted thereon. One layout of the label 71 is 
10 shown in fig. 6. The label 71 may be an adhesive optical identifier, which may be 
prepared for the particular slide and printed on a label printer (not shown) or any 
other suitable printing device. It is even possible that in a particular situation, if a 
batch of slides is to be subjected to the same treatment, a series of identical labels 
could be provided for the slides. The label 71 may comprise an area 72 for encoded 
15 information about the tissue sample on the slide 7, such as patient data, date and file 
number, the staining protocol and/or the series of process steps. Furthermore, the 
label 71 may be provided with one or more rows 73 of human readable text and/or 
blank space for the laboratory personnel preparing the slides to write on the slide 
label. 

20 

In figures 7 to 9 various kinds of data encoded symbology for the label 71 (the entire 
label 71 as shown or only for the label area 72 (see fig. 6)). 

In fig. 7, an example of a 2-D symbology of the Infoglyph™ type is shown. This 
25 may include perhaps even an information carpet type of symbology. This type of 2- 
D symbology is advantageous since it can carry a large amount of optically machine- 
readable information. Making use of a high-resolution camera, this type of 
symbology may be readable in a high resolution and a large amount of information 
can be encoded therein. The symbology may be printed with tiny diagonal lines in 



19 



WO 2004/051 




PCT7US2003/040518 



different directions or perhaps even colors and can easily be read by a CCD camera 
or the like. 

Fig. 8 shows an example of a data matrix code that can be used as an alternative to 
5 the Infoglyph symbology. The data matrix is similarly readable with a CCD camera 
but may not carry as many data in the encoding as the Infoglyph. However, it is 
easier to print as it may have a less high resolution making it a simple and cost 
effective solution if less identification data on the slides and the reagent bottles is 
required. A yet simpler solution is shown in fig. 9, where the symbology is the old 
10 bar code. In principle this means that only a bar code scanner is required for reading 
the slides and the reagent bottle information, but by using a 2-D sensor, the 
possibility of self-calibration and monitoring the installation of slides and reagents in 
the staining apparatus may be enhanced. 

15 In an embodiment, the optical identifiers on the slides and on the reagent bottles are 
the same type. This may facilitate the image processing of the identification process 
in the staining apparatus. 

A different approach to identifying the individual slides or as a way of facilitating the 
20 new capabilities of confirming identification or storing confirmatory information 
may be to record the contour and/or the texture of the tissue sample 74 itself, such as 
shown in fig. 10. Utilizing the high-resolution of the image that can be recorded by 
the camera, the unique features of the tissue sample itself can be used as a graphical 
identifier of the slide. Furthermore, an image of the stained tissue sample can be 
25 recorded so that a digital representation of the tissue sample is produced. This digital 
image can be sent electronically to remote locations for instant examination and/or 
archived for later examination. This may provide the staining apparatus with a 
unique flexibility in use and may introduce new and advantageous methods of 
analyzing the tissue samples. 

30 
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Besides identifying the microscope slides and the reagent bottles in the staining 
apparatus, the 2-D optical sensor can also be used for self-calibration of the 
apparatus, e.g. after maintenance, if the apparatus has been disassembled or moved to 
another location. By identifying critical locations within the apparatus by capturing 



image with a reference image to determine if certain critical components in the 
apparatus are off-set from their predetermined positions, e.g. if a slide rack or a slide 
is slightly off-set, and if so, a set of correction data for the robotic motion control 
system may be calculated and this set of data may be used for calibrating the 
10 apparatus. If the correction needed exceeds a certain size, a warning could be 
automatically issued to an operator, so that it is ensured that the apparatus does not 
malfunction during the processing of the slides. Furthermore, this image analysis 
system could also be used for determining if a slide is present or dislocated in the 
rack in order to produce a warning signal. 



By the invention, it is realised that a variety of changes of the above description of 
some preferred embodiments of the invention may be made without departing from 
the scope of the invention as set forth in the claims. As can be easily understood, the 
basic concepts of the present invention may be embodied in a variety of ways. It 

20 involves both staining techniques as well as various systems, assemblies, and devices 
to accomplish staining and other functions. In this application, the staining 
techniques are also disclosed as part of the results shown to be achieved by the 
various systems, assemblies, and devices described and as steps that are inherent to 
utilization. They should be understood to be the natural result of utilizing the devices 

25 as intended and described. In addition, while some devices are disclosed, it should 
be understood that these not only accomplish certain methods but also can be varied 
in a number of ways. Importantly, as to all of the foregoing, all of these facets 
should be understood to be encompassed by this disclosure. 



5 an image by the camera, the image processing software can compare the captured 
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The reader should be aware that the specific discussion may not explicitly describe 
all embodiments possible; many alternatives are implicit. It also may not fully 
explain the generic nature of the invention and may not explicitly show how each 
feature or element can actually be representative of a broader funption or of a great 

5 variety of alternative or equivalent elements. Again, these are implicitly included in 
this disclosure. Where the invention is described in device-oriented terminology, 
each element of the device implicitly performs a function. Apparatus claims may not 
only be included for the device described, but also method or process claims may be 
included to address the functions the invention and each element performs. Neither 

10 the description nor the terminology is intended to limit the scope of the disclosure. 

It should also be understood that a variety of changes may be made without departing 
from the essence of the invention. Such changes are also implicitly included in the 
description. They still fall within the scope of this invention. A broad disclosure 
15 encompassing both the explicit embodiment(s) shown, the great variety of implicit 
alternative embodiments, and the broad methods or processes and the like are 
encompassed by this disclosure and may be relied upon to support additional claims 
for presentation in this or subsequent patent application. 

20 Further, each of the various elements of the invention and claims may also be 
achieved in a variety of manners. This disclosure should be understood to 
encompass each such variation, be it a variation of an embodiment of any apparatus 
embodiment, a method or process embodiment, or even merely a variation of any 
element of these. Particularly, it should be understood that as the disclosure relates 

25 to elements of the invention, the words for each element may be expressed by 
equivalent apparatus terms or method terms — even if only the function or result is 
the same. Such equivalent, broader, or even more generic terms should be 
considered to be encompassed in the description of each element or action. Such 
terms can be substituted where desired to make explicit the implicitly broad coverage 

30 to which this invention is entitled. As but one example, it should be understood that 
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all actions may be expressed as a means for taking that action or as an element which 
causes that action. Similarly, each physical element disclosed should be understood 
to encompass a disclosure of the action which that physical element facilitates. 
Regarding this last aspect, as but one example, the disclosure of a "sensor" should be 

5 understood to encompass disclosure of the act of "sensing" — whether explicitly 
discussed or not — and, conversely, were there effectively disclosure of the act of 
"sensing", such a disclosure should be understood to encompass disclosure of a 
"sensor" and even a "means for sensing". It should also be understood that in 
jurisdictions where specific language may be construed as limiting, as but one 

10 example in the United States where some interpretations of "means for" elements can 
be construed narrowly, broader equivalent language (such as " element" or the like) 
may be used to avoid the narrow interpretation and should be understood as 
encompassed by this specification. Such changes and alternative terms are to be 
understood to be explicitly included in the description. 

15 

Any patents, patent applications, publications, or other references mentioned in this 
application for patent are hereby incorporated by reference. In addition, as to each 
term used it should be understood that unless its utilization in this application is 
inconsistent with such interpretation, common dictionary definitions should be 
20 understood as incorporated for each term and all definitions, alternative terms, and 
synonyms such as contained in the Random House Webster's Unabridged 
Dictionary, second edition are hereby incorporated by reference. Finally, any 
priority case for this application is hereby appended and hereby incorporated by 
reference. 

25 

Thus, the applicant(s) should be understood to have support to claim at least: i) each 
of the sample processing systems and subsystems as herein disclosed and described, 
ii) the related methods disclosed and described, iii) similar, equivalent, and even 
implicit variations of each of these systems, assemblies, devices and methods, iv) 
30 those alternative designs which accomplish each of the functions shown as are 
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disclosed and described, v) those alternative designs and methods which accomplish 
each of the functions shown as are implicit to accomplish that which is disclosed and 
described, vi) each feature, component, and step shown as separate and independent 
inventions, vii) the applications enhanced by the various systems or components 
5 disclosed, viii) the resulting products produced by such systems or components, and 
ix) methods and systems, assemblies, devices, and apparatuses substantially as 
described hereinbefore and with reference to any of the accompanying examples, x) 
the various combinations and permutations of each of the elements disclosed, xi) 
each potentially dependent claim or concept as a dependency on each and every one 

10 of the independent claims or concepts presented, xii) processes performed with the 
aid of or on a computer as described throughout the above discussion, xiii) a 
programmable system as described throughout the above discussion, xiv) a computer 
readable memory encoded with data to direct a computer comprising means or 
elements which function as described throughout the above discussion, xv) a 

15 computer configured as herein disclosed and described, xvi) individual or combined 
subroutines and programs as herein disclosed and described, xvii) the related 
methods disclosed and described, xviii) similar, equivalent, and even implicit 
variations of each of these systems and methods, xix) those alternative designs which 
accomplish each of the functions shown as are disclosed and described, xx) those 

20 alternative designs and methods which accomplish each of the functions shown as 
are implicit to accomplish that which is disclosed and described, xxi) each feature, 
component, and step shown as separate and independent inventions, and xxii) the 
various combinations and permutations of each of the above. 

25 Further, if or when used, the use of the transitional phrase "comprising" or the like is 
used to maintain the "open-end" claims herein, according to traditional claim 
interpretation. Thus, unless the context requires otherwise, it should be understood 
that the term "comprise" or variations such as "comprises" or "comprising" or the 
like, are intended to imply the inclusion of a stated element or step or group of 

30 elements or steps but not the exclusion of any other element or step or group of 
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elements or steps. Such terms should be interpreted in their most expansive form so 
as to afford the applicant the broadest coverage legally permissible. 

Any claims set forth at any time are hereby incorporated by reference as part of this 
5 description of the invention, and the applicant expressly reserves the right to use all 
of or a portion of such incorporated content of such claims as additional description 
to support any of or all of the claims or any element or component thereof, and the 
applicant further expressly reserves the right to move any portion of or all of the 
incorporated content of such claims or any element or component thereof from the 

10 description into the claims or vice-versa as necessary.to define the matter for which 
protection is sought by this application or by any subsequent continuation, division, 
or continuation-in-part application thereof, or to obtain any benefit of, reduction in 
fees pursuant to, or to comply with the patent laws, rules, or regulations of any 
country or treaty, and such content incorporated by reference shall survive during the 

15 entire pendency of this application including any subsequent continuation, division, 
or continuation-in-part application thereof or any reissue or extension thereon. 



25 




WO 2004/05^B PCT/US2003/040518 



CLAIMS 

What is claimed is: 

5 1 . An automatic staining apparatus comprising: 

at least one reagent container positioned within a reagent section; 
at least one sample; 

at least two staining sections separated by the reagent section; 
a robotic element adapted to affect said reagent container and said 
10 sample; 

a control element to which said robotic element is responsive; and 
an image-capture 2-D optical sensor configured to two dimensionally 
image at least one element in said automatic staining apparatus. 

15 2. An apparatus according to claim 1, wherein the optical sensor is adapted to 
locate pre-selected reference features for self-calibration of the robotic 
element. 

3. An apparatus according to claim 1 or 2, wherein the optical sensor is adapted 
20 to record an image of the finalised sample after said sample has been 

subjected to a staining protocol. 

4. An apparatus according to claim 1, wherein at least one element comprises an 
element selected from a group consisting of: a two-dimensional high- 

25 resolution symbology code, a datamatrix code, a bar code, an adhesive label, 

a two dimensional symbology zone, and a human readable text zone; and 
wherein the optical sensor is adapted to record an image of the finalised 
sample after said tissue sample has been subjected to a staining protocol. 
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5. An apparatus according to claim 1, wherein the optical sensor is configured to 
identify a feature selected from a group consisting of: the texture of the 
sample, the outline of the sample, a visual property of the sample, and an 
individual identification feature of the sample; and wherein the optical sensor 
is adapted to record an image of the finalised sample after said sample has 
been subjected to a staining protocol. 

6. A method of identifying at least one property in an automatic staining 
apparatus comprising the steps of: 

providing at least one sample; 
providing at least one reagent container; 

providing a robotic element adapted to affect said reagent container 
and said sample; 

optically sensing a two dimensional image of at least one element in 



recording relevant image data; 

recording robotic element calibration reference points in the 
apparatus; and 

feeding said image data to a control element to which said robotic 
element is responsive. 



7. A method of staining samples in an automatic staining apparatus comprising 
the steps of: 

providing at least one sample; 

providing slides in racks; 

providing at least one reagent container; 

providing a robotic element adapted to affect said reagent container 
and said sample; 



said automatic staining apparatus; 
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providing an optical sensor responsive to said robotic element and 
adapted to sense a two dimensional image of at least one element in 
said automatic staining apparatus; 
recording relevant image data; 
5 recording robotic element calibration reference positions for said 

racks; and 

feeding said image data to a control element to which said robotic 
element is responsive. 

10 8. An automatic staining apparatus comprising: 
at least one reagent container; 
at least one sample; 

a robotic element adapted to affect said reagent container and said 
sample; 

15 a control element to which said robotic element is responsive; and 

an optical sensor adapted to locate pre-selected reference features for 
self-calibration of the robotic element. 

9. An automatic staining apparatus comprising: 
20 at least one reagent container in a reagent section; 

at least one first sample contained on a slide in a first slide section; 

at least one second sample contained on a slide in a second slide 

section, wherein said first slide section and said second slide 

section are separated by said reagent section; 
25 a robotic element adapted to affect said reagent container and said 

first and said second samples; and 

a control element to which said robotic element is responsive. 
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10. An automatic staining apparatus comprising: 

at least one reagent container; 
at least one sample; 

a robotic element adapted to affect said reagent container and said 
5 sample; 

a control element to which said robotic element is responsive; and 
an image-capture 2-D optical sensor configured to two 
dimensionally image at least one element in said automatic staining 
apparatus, wherein said at least one element comprises an optical 
10 identification element having reiterated information. 

11. An apparatus according to claim 10 wherein said reiterated information 
comprises multiple reiterated information. 

15 12. An apparatus according to claim 10 wherein said reiterated information 
comprises redundant information. 

13. An apparatus according to claim 10, 12 wherein said at least one element 
comprises an optical identification element. 

20 

14. An apparatus according t to claim 11 wherein said optical identification 
element comprises a two-dimensional high-resolution symbology code. 

15. An apparatus according to claim 11 wherein said optical identification 
25 element comprises a datamatrix code. 

16. An apparatus according to claim 11 wherein said optical identification 
element comprises a bar code. 
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10 



17. An automatic staining apparatus comprising: 

at least one reagent container; 
at least one sample; 

a robotic element adapted to affect said reagent container and said 
tissue sample; 

a control element to which said robotic element is responsive; 
an image-capture 2-D optical sensor configured to two dimensionally 
image at least one element in said automatic staining apparatus; and 
a computer image biological analysis element. 

18. An apparatus according to claim 17 wherein said optical sensor comprises a 
camera. 



19. An apparatus according to claim 18, wherein said camera comprises a CCD 
15 element. 

20. An apparatus according to claim 17, wherein the samples comprises 
biological samples accommodated on slides. 

20 21. A method of identifying at least one property in an automatic staining 
apparatus comprising the steps of: 

providing at least one sample; 
providing at least one reagent container; 

providing a robotic element adapted to affect said reagent container 
25 and said sample; 

optically sensing a two dimensional image of at least one element in 
said automatic staining apparatus; 
recording relevant image data; . 

feeding said image data to a control element to which said robotic 
30 element is responsive; and 
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biologically analysing image data of said at least one sample with a 
computer. 

22. A method according to claim 21, wherein said step of optically sensing the 
5 two dimensional image of at least one element in said automatic staining 

apparatus comprises the step of utilizing a camera. 

23. A method according to claim 22, wherein said step of utilizing a camera 
comprises the step of utilizing a CCD element. 

10 

24. A method according to claim 21, 22 or 23, wherein said step of providing at 
least one sample comprises the step of utilizing a slide. 

25. A method of staining tissue samples in an automatic staining apparatus 
1 5 comprising the steps of: 

providing at least one sample; 
providing at least one reagent container; 

providing a robotic element adapted to affect said reagent container 
and said sample; 

20 providing an optical sensor responsive to said robotic element and 

adapted to sense a two dimensional image of at least one element in 
said automatic staining apparatus; 
recording relevant image data; 

feeding said image data to a control element to which said robotic 
25 element is responsive; and 

biologically analysing image data of said at least one sample with a 
computer. 

26. A method according to claim 25, wherein said step of providing at least one 
30 sample comprises the step of utilizing a slide. 
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27. A method according to claim 25 or 26, wherein said step of providing an 
optical sensor comprises the step of utilizing a camera. 

5 . 28. A method according to claim 25 or 26, wherein said step of providing an 
optical sensor comprises the step of utilizing a CCD element. 

29. A method according to claim 25, and further comprising the step of storing an 
image relevant to a process of staining tissue samples. 

10 

30. An automatic staining apparatus comprising: 

at least one reagent container; 
at least one sample; 

a robotic element adapted to affect said reagent container and said 
15 sample; 

a control element to which said robotic element is responsive; 

a multifunction optical sensor configured to sense at least one element 

in said automatic staining apparatus; and 

a computer image biological analysis element. 

20 

31. An apparatus according to claim 30, wherein said at least one sample 
comprises at least one sample accommodated on slides. 

32. An apparatus according to claim 30, wherein said optical sensor comprises a 
25 camera. 

33. An apparatus according to claim 30, wherein said optical sensor comprises a 
CCD element. . 
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34. An apparatus according to claim 30, and further comprising a stored image 
relevant to the process of staining tissue samples. 
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